Imaging apparatus and display control method thereof

ABSTRACT

An imaging apparatus includes: a first display panel unit configured to execute display toward a user side, disposed on an apparatus casing; a second display panel unit configured to execute display toward a subject side, disposed on the apparatus casing; an imaging processing unit configured to subject incident light from the subject side to photoelectric conversion to obtain a captured image signal; and a control unit configured to execute imaging processing control according to the imaging mode setting, and execute display based on the captured image signal obtained by the imaging processing unit with the first display panel unit, while controlling the display operations based on the captured image signal obtained with the imaging processing unit of the second display panel unit, at least according to the imaging mode.

CROSS-REFERENCE TO RELATED APPLICATION

The present application claims priority from Japanese Patent ApplicationNo. JP 2008-284293 filed in the Japanese Patent Office on Nov. 5, 2008,the entire content of which is incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an imaging apparatus and the displaycontrol method thereof, and specifically relates to the displayoperation of an imaging apparatus wherein multiple display panel unitsare provided on the casing thereof.

2. Description of the Related Art

Imaging apparatuses such as digital still cameras, digital videocameras, and so forth have come into widespread use, and with many ofthem, a display panel made up of a liquid crystal panel or the like isformed.

For example, as disclosed in Japanese Unexamined Patent ApplicationPublication No. 2007-158799, an arrangement is made wherein a displaypanel is provided on a camera casing with a relatively great area,monitoring of a subject image is executed at the time of imaging, andplayback display is executed at the time of playback of a capturedimage.

SUMMARY OF THE INVENTION

Now, the present assignee has newly conceived an arrangement forproviding two display panel units on the casing of an imaging apparatus.Specifically, similar to the related art, in addition to a display panelunit configured to execute display toward the user (the person using theimaging apparatus) direction on an imaging apparatus casing, a displaypanel unit configured to execute display toward a subject side isprovided to the front face side (side serving as a subject side) or thelike on the apparatus casing.

Thus, in the case that such two display panel units are provided,suitable display should be made at each display panel, i.e., displayeffective for a viewer, and display operation so as to avoid wastefuloperations and consumption power, according to the operation state orsituation relating to imaging.

It has been found to be desirable to realize suitable display at animaging apparatus including two display panel units.

According to an embodiment of the present invention, an imagingapparatus includes: a first display panel unit configured to executedisplay toward a user side, disposed on an apparatus casing; a seconddisplay panel unit configured to execute display toward a subject side,disposed on the apparatus casing; an imaging processing unit configuredto subject incident light from the subject side to photoelectricconversion to obtain a captured image signal; and a control unitconfigured to execute imaging processing control according to theimaging mode setting, and execute display based on the captured imagesignal obtained by the imaging processing unit with the first displaypanel unit, while controlling the display operations based on thecaptured image signal obtained with the imaging processing unit of thesecond display panel unit, at least according to the imaging mode.

Also, the control unit may perform control to execute display based onthe captured image signal obtained with the imaging processing unit onthe second display panel, in the case that the imaging mode is apredetermined imaging mode determined beforehand out of multiple imagingmodes.

Also, the control unit may perform control to turn the display of thesecond display panel off in the case that the imaging mode is not thepredetermined imaging mode.

Also, the control unit may perform control to execute display based onthe captured image signal obtained with the imaging processing unit onthe second display panel unit in a low luminance state, in the case thatthe imaging mode is not the predetermined imaging mode.

Also, the imaging apparatus may further include: an image data readingunit configured to read image data recorded on a storage medium; whereinthe control unit performs control to execute display based on image dataread out by the image data reading unit on the second display panel, inthe case that the imaging mode is not the predetermined imaging mode.

Also, the control unit may control the display operation based on thecaptured image signal obtained with the imaging processing unit on thesecond display panel unit, based on the imaging mode and a settingsstate according to the operations of the user relating to operations ofthe imaging apparatus other than the imaging mode.

Also, the control unit may control the display operation based on thecaptured image signal obtained with the imaging processing unit on thesecond display panel unit, based on the imaging mode and the internaldetecting information of the imaging apparatus.

Also, the imaging apparatus may further include: an image analysis unitconfigured to perform image analysis of the captured image signalobtained with the imaging processing unit, wherein the control unitcontrols the display operation based on the captured image signalobtained with the imaging processing unit with the second display panelunit, based on the imaging mode, and image analysis information from theimage analysis unit.

Also, the image analysis unit may detect whether or not a person existsat the subject side from the image analysis of the captured image signalobtained with the imaging processing unit.

Also, the imaging apparatus may further include: an operating unitconfigured to select the imaging mode.

A display control method for the imaging apparatus with a first displaypanel unit configured to execute display toward a user side and a seconddisplay panel unit configured to execute display toward a subject sideincludes the steps of: executing display on the first display panelbased on a captured image signal obtained by subjecting incident lightfrom the subject side to photoelectric conversion; and with a seconddisplay panel unit configured to execute display toward a subject side,disposed on the apparatus casing; and controlling display operations ofsaid captured image signal on the second display panel according to animaging mode selected from various types of imaging modes to performimaging processing suitable to the imaging situation.

That is to say, according to the above configuration, operations for thesecond display panel unit are performed according to imaging mode. Animaging mode is a mode set according to various types of imagingsituations and imaging objectives. For example, these are modes that auser can select, for example, so that imaging processing suitable can beperformed according to what sort of image is desired in what sort oflocation and situation, for example. Exposure adjusting conditions,signal processing parameters, and so forth are set for each of varioustypes of imaging modes.

In the case of the above configuration, the possibility of a personexisting at the subject side is determined, and display with the seconddisplay panel unit is performed.

Also, for example, during the monitoring period at the time of imagingof a still image (when awaiting a suitable timing for imaging of a stillimage), the user of the imaging apparatus (i.e., a user who attempts toperform imaging of a still image with the imaging apparatus) performsmonitoring of a subject image using the first display panel unit. Thismonitoring image is a captured image signal to be obtained at theimaging device unit during that period, also referred to as a throughimage, a real time moving image of a subject scene. The user confirmsthe subject image thus imaged to perform a release operation (shutteroperation) at a desired timing. This is the same as with a commonimaging apparatus.

During this monitoring period, with the second display panel unit, it issuitable to execute display based on a captured image signal, i.e.,display a monitoring image serving as a through image. For example, inthe case that a subject is a person, the person thereof can confirm hisfacial expression, pose, or the like to be imaged through the display ofthe second display panel unit.

However, this is effective only when the person is on the subject side.For example, when the user selects a scenery mode serving as an imagingmode, and attempts to image scenery where there is no person, it can beconceived that there is no person who view the display of the seconddisplay panel unit. Therefore, in such a case, there is no meaning evenif a monitoring image is displayed on the second display panel unit.Consequently, it is suitable to attempt to perform power saving byturning off the second display panel unit.

For example, the display operations of the second display panel unitsare controlled suitably according to the status estimated from theimaging mode at that time, whereby useful display or more enjoyabledisplay by the two display panel units, avoidance of increase inexcessive consumption power even if the two display panel units areprovided, or the like can be realized.

According to the above configuration, with an imaging apparatus, twodisplay panel units are provided whereby the user side and the subjectside can visually recognize their sides respectively, and each displaypanel can execute suitable display according to the imaging statusestimated by the imaging mode.

Particularly, whether or not there is a person at the subject side whocan view the second display panel and the display thereupon unit isassumed, and the display operation of the second display panel unit iscontrolled accordingly.

That is to say, useful display, display with high enjoyableness,avoidance of wasteful display, or the like can be realized, andaccordingly, a new and useful imaging apparatus can be provided.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B are explanatory diagrams of an external view example ofan imaging apparatus according to an embodiment of the presentinvention;

FIG. 2 is a block diagram of the imaging apparatus according to theembodiment;

FIG. 3 is an explanatory diagram of the operation transition of theimaging apparatus according to the embodiment;

FIGS. 4A through 4C are explanatory diagrams of an image display exampleof the imaging apparatus according to the embodiment;

FIGS. 5A through 5C are explanatory diagrams of an image display exampleof the imaging apparatus according to the embodiment;

FIG. 6 is a flowchart of a display control example of a front displaypanel based on the imaging mode of the embodiment;

FIG. 7 is a flowchart of a display control example of a front displaypanel based on the imaging mode of the embodiment;

FIG. 8 is a flowchart of a display control example with considerationfor a self-imaging mode on the front display panel of the embodiment;

FIG. 9 is a flowchart of a display control example of the front displaypanel based on the imaging mode and user settings of the embodiment;

FIG. 10 is a flowchart of a display control example of the front displaypanel based on the imaging mode and camera detection information of theembodiment;

FIG. 11 is a flowchart of a display control example of the front displaypanel based on the imaging mode and image analysis results of theembodiment;

FIG. 12 is a flowchart of a display control example of the front displaypanel based on the imaging mode and image analysis results of theembodiment;

FIG. 13 is a flowchart of a display control example of the front displaypanel based on the imaging mode and image analysis results of theembodiment;

FIG. 14 is a flowchart of a display control example of a front displaypanel with consideration for a smile shutter mode of the embodiment; and

FIG. 15 is a flowchart of a display control example of a front displaypanel at time of playback of the embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Description will be made below regarding an embodiment of the presentinvention in accordance with the following sequence.

1. Configuration of Imaging Apparatus

2. Operation Transition

3. Screen Display Examples of Both Display Panel Units

4. Display Control of Front Display Panel Unit When Monitoring

<4-1: Processing Example Based on Imaging mode>

<4-2: Processing Example Based on Imaging mode and User Settings>

<4-3: Processing Example Based on Imaging mode and Internal DetectingInformation>

<4-4: Processing Example Based on Imaging mode and Image AnalysisInformation>

5. Display Control of Front Display Panel Unit During Playback

6. Modification Examples

1. Configuration of Imaging Apparatus

As an embodiment of the present invention, the configuration of animaging apparatus, for example, serving as a digital camera, will bedescribed with reference to FIGS. 1A, 1B, and 2.

FIGS. 1A and 1B illustrate an external view of an imaging apparatus 1according to the present example as viewed from the back side (userside) and front side (subject side) thereof. With the imaging apparatus1, an imaging lens unit 20 and a flash emitting unit 15, and so forthare provided to the front side.

Also, operators used for user operations are formed on various portionssuch as the casing upper face, back side, and so forth. For example,there are provided a release operation key 5 a, a dial operating portion5 b, a wide/tele operation key 5 c, various types of operating keys 5 d,a D-pad 5 e, and so forth. The dial operating portion 5 b is used forselection of an imaging mode or the like, for example. Operations suchas a menu instruction, a playback instruction, an exposure correctioninstruction, and so forth are available through the operating keys 5 d.The D-pad 5 e is used for various types of operations includingselection/determination of an operation menu item to be displayed on adisplay panel 6, for example.

With the imaging apparatus 1, as shown in FIG. 1A, a main display panel6M made up of a liquid crystal panel, an organic electroluminescence(EL) panel, or the like is provided to the back side, and as shown inFIG. 1B, a front display panel 6F similarly made up of a liquid crystalpanel, an organic EL panel, or the like is provided to the front side.

The main display panel 6M and the front display panel 6F have, forexample, the same screen size, and are provided so as to occupy arelatively wide area of the casing back and the casing frontrespectively. With the main display panel 6M, basically, during themonitoring period (when awaiting a suitable timing in the imaging mode)display of a monitoring image (through image) where a user is a subjectis executed, whereby the user can confirm a subject scenery serving asan imaging target. Also, with a playback mode, display of a playbackimage or thumbnail images is executed in accordance with the operationby the user.

On the other hand, the front display panel 6F is directed to the subjectside to execute display. With the front display panel 6F as well, anarrangement is made wherein display of a monitoring image or the like isexecuted, whereby a person serving as the subject side can view displaycontent thereof, which will be described later.

A configuration example of such an imaging apparatus will be describedwith reference to FIG. 2. As shown in FIG. 2, the imaging apparatus 1includes an imaging system 2, a control system 3, a camera digitalsignal processor (DSP) 4, an operating unit 5, a main display panel 6M,a front display panel 6F, a display controller 7, an external interface8, SDRAM (Synchronous Dynamic Random Access Memory) 9, and a mediuminterface 10.

The imaging system 2 is a portion to execute an imaging operation, andincludes a lens mechanical unit 21, a diaphragm/ND filter mechanism 22,an imaging device unit 23, an analog signal processing unit 24, an A/Dconversion unit 25, a lens driving unit 26, a lens position detectingunit 27, a timing generating circuit 28, a blurring detecting unit 13,an emission driving unit 14, a flash emitting unit 15, a lens drivingdriver 17, a diaphragm/ND driving driver 18, and an imaging devicedriver 19.

The incident light from a subject is guided to the imaging device unit23 via the lens mechanical unit 21 and the diaphragm/ND filter mechanism22. The lens mechanical unit 21 is the internal configuration of theimaging lens unit 20 in FIG. 1B, and includes multiple optical lensgroups such as a cover lens, a focus lens, a zoom lens, and so forth.Also, the lens driving unit 26 is a transfer mechanism to transfer thefocus lens or zoom lens in the optical axis direction. The lens drivingunit 26 to which driving power is applied by the lens driving driver 17transfers the focus lens or zoom lens. A later-described CPU (CentralProcessing Unit) 31 controls the lens driving driver 17, therebyexecuting focus control or zoom operation.

The diaphragm/ND filter mechanism 22 includes a diaphragm mechanism, andan ND filter mechanism to attenuate an incident light quantity by beinginserted into the lens optical system, and executes optical quantityadjustment. The diaphragm/ND filter mechanism 22 executes opticalquantity adjustment by opening/closing a diaphragm mechanism. Also, thediaphragm/ND driving driver 18 takes an ND filter in and out as to theoptical axis of incident light, thereby adjusting an incident lightquantity. The CPU 31 controls the diaphragm/ND driving driver 18 todrive the diaphragm mechanism or ND filter, whereby incident lightquantity control (exposure adjustment control) can be executed.

The luminous flux from the subject passes through the lens mechanicalunit 21 and the diaphragm/ND filter mechanism 22, whereby a subjectimage is formed on the imaging device unit 23. The imaging device unit23 subjects the formed subject image to photoelectric conversion tooutput the captured image signal corresponding to the subject image. Theimaging device unit 23 includes a rectangular imaging region made up ofmultiple pixels, and sequentially outputs, to the analog signalprocessing unit 24, the image signal that is the analog signalcorresponding to the charge accumulated in each pixel in increments ofpixels. For example, a CCD (Charge Coupled Device) sensor array, a CMOS(Complementary Metal Oxide Semiconductor) sensor array, or the like isused as the imaging device unit 23.

The analog signal processing unit 24 internally includes a CDS(Correlation Double Sampling) circuit, an AGC (Automatic Gain Control)circuit, and so forth, and subjects the image signal input from theimaging device unit 23 to a predetermined analog process. The A/Dconversion unit 25 converts the analog signal processed as the analogsignal processing unit 24 into a digital signal, and supplies this tothe camera DSP 4.

The timing generating circuit 28, which is controlled by the CPU 31,controls the timing of various operations of the imaging device unit 23,analog signal processing unit 24, and A/D conversion unit 25.

Specifically, the timing generating circuit 28 supplies, in order tocontrol the imaging operation timing of the imaging device unit 23, atiming signal for exposure/charge readout, a timing signal serving as anelectric shutter function, a transfer clock, a synchronizing signalaccording to a frame rate, and so forth to the imaging device unit 23via the imaging device driver 19. Also, the timing generating circuit 28also supplies the above various timing signals to the analog signalprocessing unit 24 so that the analog signal processing unit 24 canexecute a process in sync with transfer of an image signal at theimaging device unit 23.

The CPU 31 executes control of each timing signal generated by thetiming generating circuit 28, whereby change of the frame rate of acaptured image, and electric shutter control (exposure time variablecontrol within a frame) can be executed. Also, the CPU 31 provides again control signal to the analog signal processing unit 24 via thetiming generating circuit 28, whereby gain variable control of acaptured image signal can be executed.

The blurring detecting unit 13 detects a shaking quantity, and themotion amount of the imaging apparatus 1 itself. The blurring detectingunit 13 is configured of, for example, an acceleration sensor, avibration sensor, or the like, and supplies detection informationserving as a blurring quantity to the CPU 31.

The flash emitting unit 15 is driven by the emission driving unit 14 soas to emit flash light. The CPU 31 instructs the emission driving unit14 to execute flash emission at a predetermined timing such as theuser's operation or the like, whereby the flash emitting unit 15 can beemitted.

The camera DSP 4 subjects the captured image signal to be input from theA/D conversion unit 25 of the imaging system 2 to various types ofdigital signal processes. With the camera DSP 4, processing functions,for example as shown in the drawing, such as the image signal processingunit 41, compression/decompression processing unit 42, SDRAM controller43, image analyzing unit 44, and so forth are realized with the internalhardware and software.

The image signal processing unit 41 executes a process as to an inputcaptured image signal. For example, the image signal processing unit 41executes an autofocus (AF) process, an auto exposure (AE) process, orthe like as an operation process used for driving control of the imagingsystem 2 using a captured image signal, and also executes an auto whitebalance (AWB) process or the like as a process as to a captured imagesignal itself to be input.

For example, as the autofocus process, the image signal processing unit41 executes contrast detection as to an input captured image signal, andtransmits the detection information to the CPU 31. Various types ofcontrol methods have been used as an autofocus control methods, but witha technique referred to as “contrast AF”, contrast detection is executedregarding the captured image signal at each point in time while movingthe focus lens forcibly, thereby determining the position of the focuslens in the optimal contrast state. That is to say, the CPU 31 executescontrol to confirm the contrast detection value detected at the imagesignal processing unit 41 while executing the movement control of thefocus lens prior to an imaging operation, and to determine a position inthe optimal contrast state as a focus optimal position.

Also, as focus control during imaging a detection method referred to asso-called wobbling AF can be executed. The CPU 31 confirms the contrastdetection value detected at the image signal processing unit 41 whilemoving the position of the focus lens by swaying the focus lens minutelyforward and backward all the time during an imaging operation. Theoptimal position of the focus lens changes depending to the state of asubject, but contrast detection is executed while changing the focuslens minutely forward and backward, whereby change in the format controldirection can be determined according to change in the subject. Thus,autofocus can be executed while tracking the state of a subject.

Note that, with a transfer mechanism of the lens driving unit 26, anaddress is assigned thereto for each of transfer positions, and a lensposition is distinguished with the transfer position address thereof.

The lens position detecting unit 27 distinguishes the address of thefocus lens serving as the current lens position of the focus lens,thereby calculating distance to a subject in a focused state, andaccordingly, this can be supplied to the CPU 31 as distance information.Thus, the CPU can distinguish distance to a principal subject in afocused state.

As the auto exposure process executed by the image signal processingunit 41 of the camera DSP 4, for example, calculation of subjectluminance is executed. For example, the average luminance of inputcaptured image signals is calculated, and this is supplied to the CPU 31as subject luminance information, i.e., exposure quantity information.As calculation of average luminance, various types of methods can beconceived, for example, such as calculation of the average valueregarding the luminance signal values of all the pixels of the capturedimage data of one frame, calculation of the average value of luminancesignal values wherein weight is provided to the center portion of animage, or the like.

The CPU 31 can execute automatic exposure control based on this exposurequantity information, i.e., can execute exposure adjustment inaccordance with electronic shutter control at the diaphragm mechanism,ND filter, or imaging device unit 23, or gain control as to the analogsignal processing unit 24.

The image signal processing unit 41 of the camera DSP 4 executesautomatic white balance, gamma correction, an edge enhancement process,a shaking correction process, or the like as the signal process of thecaptured image signal itself in addition to a signal generating processused for autofocus operation or auto exposure operation.

The compression/decompression processing unit 42 of the camera DSP 4executes a compression process as to the captured image signal, or adecompression process as to the compressed image data. For example, thecompression/decompression processing unit 42 executes a compressionprocess/decompression process using a method such as JPEG (JointPhotographic Experts Group), MPEG (Moving Picture Experts Group), or thelike.

The SDRAM controller 43 executes writing/readout as to the SDRAM 9. TheSDRAM 9 is used for temporary storing of the captured image signal inputfrom the imaging system 2, storing at the process stage at the imageprocessing unit 41 or compression/decompression processing unit 42,ensuring of a work region, storing of information obtained at theinformation analyzing unit 44, or the like, and the SDRAM controller 43executes writing/readout of such data as to the SDRAM 9.

The image analyzing unit 44 executes image analysis, for example,regarding the captured image data processed at the image signalprocessing unit 41, and executes various types of image recognition. Inthe case of the present example, the image analyzing unit 44 executes arecognition process of a person or face included in a subject image.Also, in the case of recognizing a person's face, the image analyzingunit 44 executes a recognition process for facial orientation, sightdirection, or the like in some cases. Further, the image analyzing unit44 detects various types of information that can be recognized by imageanalysis, such as the size of relative motion between the imagingapparatus 1 and a subject, or the like in some cases.

The control system 3 includes the CPU 31, RAM 32, flash ROM 33, andclock circuit 34. Each unit of the control system 3, camera DSP 4, andeach unit of the imaging system 2, display controller 7, externalinterface 8, and medium interface 10 can communicate image data andcontrol information mutually via the system bus.

The CPU 31 controls the whole of the imaging apparatus 1. Specifically,the CPU 31 executes various types of operation processes, and exchangeof a control signal or the like as to each unit based on the programstored in the internal ROM or the like, and the user's operation by theoperating unit 5, thereby causing each unit to execute a predeterminedoperation. Particularly, the CPU 31 executes display control at the maindisplay panel 6M, and a control process used for display operation of alater-described front display panel 6F, or the like.

The RAM (Random Access Memory) 32 is used for temporary storing of thecaptured image signal (image data of each frame) processed at the cameraDSP 4, and storing of information according to each type of process ofthe CPU 31.

The flash ROM 33 is used for storing of image data (imaged as a stillimage or moving image by the user) serving as a captured image, orstoring of information requested for being saved in a nonvolatilemanner. The flash ROM 33 may store control software programs of theimaging apparatus 1, the setting data of the camera, and so forth.

The clock circuit 34 counts the current date and time information (year,month, day, hour, minute, second).

The operating unit 5 is configured of various types of operators (5 athrough 5 e, etc.) shown in FIGS. 1A and 1B, and a signal generatingunit based on the operation thereof. The user's operation information byvarious types of operators is transmitted from the operating unit 5 tothe CPU 31. Note that the operating unit 5 may be configured so as toallow the user to perform touch panel operations in addition tooperations by the operators. For example, an arrangement may be madewherein a touch sensor is provided to the main display panel 6M, andoperation input is performed by the user's touch operation as to screendisplay.

The display controller 7 controls the main display panel 6M and thefront display panel 6F to execute a predetermined display operationbased on the control of the CPU 31.

As a display operation at the main display panel 6M, monitoring display(so-called through image display), playback image display read out fromthe recording medium 90 or flash ROM, operation menu display, varioustypes of icon display, point-in-time display, or the like is executed.Also, as a display operation at the front display panel 6F, monitoringdisplay, or playback image display is executed.

The medium interface 10 executes readout/writing of data as to therecording medium 90 such as a memory card (card-shaped removable memory)set within the imaging apparatus 1, or the like based on the control ofthe CPU 31. For example, the medium interface 10 executes an operationto record still image data or moving image data serving as an imagedresult in the recording medium 90. Also, the medium interface 10executes an operation to read out image data from the recording medium90 at the time of the playback mode.

Note that the portable memory card is exemplified as the recordingmedium 90 here, but another type of recording medium may be used as longas this medium can be used for recording image data serving as a stillimage or moving image to be kept as an imaged result. For example, aportable disk medium such as an optical disc or the like may be used, oran HDD (Hard Disk Drive) may be installed to record image data.

The external interface 8 executes transmission/reception of varioustypes of data as to an external apparatus via a predetermined cable inaccordance with a signal standard, such as USB (Universal Serial Bus) orthe like, for example. It goes without saying that an external interfaceaccording to another standard such as IEEE (Institute of Electrical andElectronics Engineers) 1394 or the like may be used regardless of theUSB method.

Also, the external interface 8 may be configured by a wirelesstransmission method such as infrared transmission, short-distancewireless communication, or the like instead of a cable transmissionmethod.

The imaging apparatus 1 can execute data transmission/reception as tovarious types of equipment such as a personal computer or the like viathe external interface 8. For example, captured image data can betransferred to an external apparatus.

Note that a proximity sensor 50 is shown in FIG. 2. Let us say that theproximity sensor 50 is a sensor to detect whether or not there is aperson in front of the imaging apparatus 1 (subject side). For example,a pyroelectric sensor or the like can be employed. As described above,in the case that person detection is executed by the image analyzingprocess of the image analyzing unit 44, the proximity sensor 50 may notbe provided, or person detection by image analysis, and detection by theproximity sensor 50 may be used together.

2. Operation Transition

The transition of the operation state of the imaging apparatus 1 of thepresent example will be described with reference to FIG. 3. The variousoperation states are operation states viewed particularly from theperspective of the display content of the main display panel 6M.

The operation state of the imaging apparatus 1 is changed to themonitoring period, recording period, preview period, and playback periodaccording to the user's operation or the like. Note that, in reality,there are other operation states such as a period wherein communicationwith an external apparatus is executed, but description thereof will beomitted for the sake of simplifying explanation.

When the imaging apparatus 1 is, for example, powered on, the monitoringoperation is started. Note that, there are cases where the imagingapparatus 1 goes to a playback operation state at the time of power-on,such as a case where the user performs a playback operation from apower-off state, or the like.

The monitoring period is an operation period used for executing imagingby the imaging system 2. In the case that the user commonly uses theimaging apparatus 1 to execute imaging of a still image, first, thismonitoring operation is executed.

With this monitoring period, a subject image (through image) isdisplayed on the main display panel 6M. Specifically, the CPU 31controls the imaging system 2 and camera DSP 4 to execute an operationfor imaging during the monitoring period. Subsequently, the CPU 31stores the captured image data for each frame supplied from the cameraDSP 4, for example, in the RAM 32. Subsequently, the CPU 31 transfersthe captured image data for each frame to the display controller 7, andcontrols the main display panel 6M to execute monitoring display. Atthis time there is a case where the front display panel 6F is alsocontrolled to execute monitoring display, which will be described later.

During this monitoring period, the user selects a subject, or awaits asuitable timing to take a picture, while viewing the display of the maindisplay panel 6M.

During the monitoring period, upon the user pressing the releaseoperation key 5 a, i.e., upon the user performing a shutter operation,the operation state enters the recording period.

The CPU 31 executes a process to store the captured image data of oneframe to be imaged at the timing of this release operation as stillimage data. Specifically, the CPU 31 transfers the captured image datacaptured at such timing to the medium interface 10 to record this in therecording medium 90.

Note that a recording operation according to a release operation may beexecuted not as to the recording medium 90 but as to the flash ROM 33.Also, an operation system may be employed wherein recording is usuallyexecuted as to the recording medium, but in the case that the recordingmedium 90 is not mounted, recording is executed as to the flash ROM 33.This recording period is a very short period of time immediately after arelease operation as viewed from the user, and is a state whereinnothing is displayed on the main display panel 6M for example.

A certain period of time immediately after a recording operationaccording to a release operation will be referred to as the previewperiod. The preview period is a period wherein the image recorded in theimmediately previous recording operation is displayed on the maindisplay panel 6M, i.e., a period wherein the user is allowed to confirmthe imaged still image immediately after.

For example, a period of two seconds to several seconds is the previewperiod, and during this period the CPU 31 executes control to displaythe recorded still image data on the main display panel 6M.

Upon predetermined time serving as the preview period having elapsed,the CPU 31 returns the operation state to the monitoring state, andexecutes operation control serving as the monitoring period. That is tosay, a series of operations as imaging of a still image is executed asthe monitoring period, recording period, and preview period.

Note that, with the imaging apparatus 1, imaging of a moving image canbe executed, but in the case of a moving image, the recording periodcontinues during a period from the start to the end of imaging of themoving image thereof. Also, in this case, no preview period is provided.

In the case that the user has performed an operation to instruct aplayback operation, the imaging apparatus 1 proceeds to a playbackoperation state (playback period). During the playback period, anoperation to play the image recorded in the recording medium 90 or flashROM 33 by imaging or the like is executed.

The CPU 31 reads out the image recorded in the recording medium 90 orflash ROM 33 in response to the user's operation, and instructs thedisplay controller 7 to display thumbnail images or a playback image onthe main display panel 6M. Also, the playback image is displayed on thefront display panel 6F in some cases.

3. Screen Display Examples of Both Display Panel Units

Screen display examples to be displayed on the main display panel 6M andthe front display panel 6F of the imaging apparatus 1 according to thepresent example will be described with reference to FIGS. 4A through 5C.

FIGS. 4A through 5A show examples of a screen display performed duringthe monitoring period.

FIG. 4A illustrates a state in which monitoring image (through image) isdisplayed on the main display panel 6M, and display is off on the frontdisplay panel 6F.

FIG. 4B illustrates a state in which a monitoring image is displayed onthe main display panel 6M, and the same monitoring image is alsodisplayed on the front display panel 6F.

FIG. 4C illustrates a state in which a monitoring image is displayed onthe main display panel 6M, and a different monitoring image, a playbackimage for example, is displayed on the front display panel 6F. Theplayback image may be a playback image of an image imaged in the pastand recorded in the recording medium 90 or flash ROM 33, or may be animage stored in the imaging apparatus 1 beforehand. An example of thiscase is a case where image data is prepared so as to be displayed whenno monitoring image is displayed on the front display panel 6F, and isstored as a preset image in the flash ROM 33 or the like beforehand, andthe preset image data thereof is read out and displayed.

Further, the playback image is not restricted to image data serving as aso-called captured image, text data, animation data, computer graphicsdata, or the like is recorded in the recording medium 90 or flash ROM33, and such data may be displayed. That is to say, the playback imageincludes any kind of image that can be displayed. FIG. 5A is an examplewherein display is off on the main display panel 6M, and display of amonitoring image is displayed on the front display panel 6F.

These examples may be conceived to be display states of the main displaypanel 6M and front display panel 6F during the monitoring period, butwhat sort of display to perform is controlled by the CPU 31 according tothe status of the subject, operating status of the imaging apparatus 1,and imaging mode during the monitoring period.

FIGS. 5B and 5C show examples of the screen display performed during theplayback period. FIG. 5B illustrates a state in which list display bythe thumbnail images of the playback image is executed on the maindisplay panel 6M, and on the other hand, with the front display panel6F, a playback image under selection by a cursor K within a thumbnailimage is displayed. FIG. 5C illustrates a state in which one playbackimage is displayed on the main display panel 6M, and the same playbackimage is also displayed on the front display panel 6F.

These examples may be conceived to be display states of the main displaypanel 6M and front display panel 6F during the playback period. It goeswithout saying that other examples may also be considered. For example,displaying the playback image on the main display panel 6M anddisplaying the preset image on the front display panel 6F may beconsidered. Also, performing a menu display of the thumbnail images onthe main display panel 6M while performing sequential display (displayas a slide show) of the various playback images on the front displaypanel 6F may also be considered.

Although a display example is shown in FIGS. 4A through 5C, the displaywith the main display panel 6M which faces the user that performsimaging operations and playback operations and so forth is basically asfollows.

First the monitoring image is displayed in the monitoring period. Also,the image that is imaged and recorded is temporarily displayed in thepreview period. The thumbnail image and playback images are displayed inthe playback period according to user operations and so forth. The CPU31 controls the main display panel 6M so as to execute these displaysaccording to operating state and operations.

On the other hand, the CPU 31 performs display control of the frontdisplay panel 6F from the perspective of executing useful displays orinteresting displays as to the person viewing the front display panel6F. The various types of display control examples of the front displaypanel 6F will be described below.

4. Display Control of Front Display Panel Unit at Time of Monitoring<4-1: Processing Example Based on Imaging Mode>

FIG. 6A shows a display control example that the CPU executes regardingthe front display panel 6F during the monitoring period. As describedabove, the monitoring image obtained with the processing in the imagingsystem 2 and camera DSP 4 is displayed on the main display panel 6M.That is to say, the CPU 31 executes control to display the capturedimage data supplied from the camera DSP 4 on the main display panel 6Mas a through image during the monitoring period.

At this time, in order to perform the display control of the frontdisplay panel 6F, the CPU 31 performs processing in FIG. 6A in parallelwith the display control of the main display panel 6M.

First in step F101, the CPU 31 confirms the current imaging mode. Theimaging mode will be described now.

The imaging mode is a mode that the user selects so as to performimaging in a suitable state under various situations, such as a nightview mode, night view and person mode, portrait mode, scenery mode,“soft snap” mode, snow mode, beach mode, high-speed shutter mode,high-sensitivity mode, smile shutter mode, and so forth.

With each of these imaging modes, suitable shutter speed, suitableexposure setting, suitable signal gain setting as to a captured imagesignal, suitable signal process settings such as edge enhancement andcolor process, and so forth have already been determined, and thesesettings can be selected by the user, for example, according to theoperations of the dial operating portion 5 b shown in FIG. 1A.

The night view mode is an imaging mode wherein imaging is executed withsettings suitable for night view imaging. The night view and person modeis an imaging mode wherein imaging is executed with settings capable ofimaging the night view of the back and the facial expression of a personwith vivid clarity.

The portrait mode is an imaging mode wherein imaging is executed withsettings suitable for person imaging.

The scenery mode is an imaging mode wherein imaging is executed withsettings suitable for scenery imaging.

The “soft snap” mode is an imaging mode wherein imaging is executed withsettings to give a viewer the impression that the texture of the skin ofa person is bright and soft.

The high-speed shutter mode is an imaging mode wherein imaging isexecuted with settings suitable for a moving subject.

The high-sensitivity mode is an imaging mode wherein imaging is executedwith natural mood using neither dark scenes nor flash.

The smile shutter mode is an imaging mode wherein upon a subject personbecoming a smiling face, a shutter process (release) is automaticallyexecuted when the subject person smiles.

Though an imaging mode used for executing an imaging process suitablefor such an imaging situation is selected by the user, the CPU 31executes imaging process control according to the imaging mode settingswith the stage of still image imaging from the monitoring period to therecording period. That is to say, the CPU 31 executes various types ofparameter instructions as to the imaging system 2 and camera DSP 4according to the imaging mode selected by the operation of the dialoperating portion 5 b. For example, an instruction is executed, such asthe above shutter speed settings, exposure settings, signal processsettings, or the like.

Step F101 in FIG. 6A is processing to branch the processing depending oncurrently which imaging mode is used as such an imaging mode. In thecase that, of the above-mentioned various types of imaging modes, thecurrent imaging mode is a predetermined imaging mode suitable to thedisplay of the monitoring image on the front display panel 6F, the CPUadvances the processing to step F102, and executes monitoring imagedisplay on the front display panel 6F. That is to say, the displaycontroller 7 is instructed to display the monitoring image displayed onthe main display panel 6M also on the front display panel 6F. In thiscase, the display states of the main display panel 6M and the frontdisplay panel 6F are states such as shown in FIG. 4B.

On the other hand, in step F101 in the case that the current imagingmode is confirmed to not be a predetermined imaging mode suitable to thedisplay of the monitoring image on the front display panel 6F, the CPU31 advances the processing to step F103, and controls the display of thefront display panel 6F to be turned off. In this case, the displaystates of the main display panel 6M and the front display panel 6F arestates such as shown in FIG. 4A.

The CPU 31 repeatedly executes the processing in FIG. 6A herein duringthe monitoring period. The monitoring period ending is, for example, ina case of release operation performed and transferring to a recordingaction, or in a case of playback operations performed and moving toplayback action, or a case of the power off operation of the imagingapparatus 1 performed and performing power off processing. Thus, untilthe monitoring period is ended, the CPU 31 repeatedly executes theprocessing in FIG. 6A.

Accordingly during the monitoring period, in the case that thepredetermined imaging mode is selected as the imaging mode, themonitoring image is displayed on the front display panel 6F as shown inFIG. 4B, and in the case that the predetermined imaging mode is notselected, the front display panel 6F is turned off as shown in FIG. 4A.

For example, of the various described imaging modes, in step F101 theCPU 31 determines the predetermined imaging mode suitable to the displayof the front display panel 6F to be a night scene and person mode,portrait mode, “soft snap” mode, smile shutter mode, and so forth. Thatis to say, these imaging modes are determined beforehand to beapplicable to the predetermined imaging mode in the processing in stepF101.

These imaging modes are selected in the case of having the objective ofimaging of a person, and accordingly, there is a high possibility that aperson is included as a subject. That is to say, there is a highpossibility that there is a person who can view the display of the frontdisplay panel 6F as a subject.

Therefore, the CPU 31 determines that if the imaging mode is one of thenight view and person mode, portrait mode, “soft snap” mode, and smilingshutter mode, in step F102 the monitoring image is displayed on thefront display panel 6F.

In the case that the imaging mode is an imaging mode other than those,i.e., the night view mode, scenery mode, high-speed shutter mode, orhigh-sensitivity mode, the imaging mode is assumed to be selected in thecase of having no objective of imaging of a person, or the visibility ofthe front display panel 6F is assumed to be in a poor state.

For example, the night view mode and the scenery mode are intended forscenery imaging, and a situation can be assumed wherein no person isincluded in the subject, or even if a person is included, the personthereof has no primary role within the image. Also, in the case of thenight view mode or high-sensitivity mode, even if there is a person infront, a monitoring image displayed at the time of imaging a dark sceneon the front display panel 6F would result in poor visibility from theperson in front thereof.

Also, a subject in the high-speed mode is a subject in motion. Forexample, even if a person is the subject, the person is in a situationsuch as participating in a sporting event, is dancing, or the like, andaccordingly, the person thereof is in no situation to carefully view thefront display panel 6F.

That is to say, in the case of these imaging modes, a situation isassumed wherein there is no person in front, or even if there is aperson in front, the front display panel 6F is displayed with poorvisibility, or the person thereof is not in a state to view the frontdisplay panel 6F.

Thus the CPU 31 turns the front display panel 6F off in step F103 in thecase that the imaging mode is one of a night scene mode, scenery mode,high-speed shutter mode, and high sensitivity mode.

Note that the above modes are examples, in addition to those, an eveningview mode wherein imaging is executed with settings suitable for eveningview imaging, a macro mode suitable for closeup of objects such asplants, insects, or the like, a firework mode suitable for imaging offireworks, an underwater mode suitable for imaging under water, or thelike, is provided in some cases. Also, a snow mode wherein imaging isexecuted with settings capable of expressing ski slopes and silvery snowof snow-covered landscapes as they appear to the human eye, a beach modewherein imaging is executed with settings whereby the blue of the seaand sky is highlighted, or the like is provided in some cases.

In these cases as well, it should be set beforehand how to determine instep F101 (whether or not the imaging mode is included in thepredetermined imaging modes to execute the display of the front displaypanel 6F) according to whether or not there is a person, the visibilityof the display content of the front display panel 6F, and the situationof a person on the subject side.

That is to say, according to the processing example in FIG. 6A, duringthe monitoring, the possibility that a person exists on the front side(subject side), or the visibility of the front display panel 6F, isestimated according to the imaging mode. In the case there is a greatpossibility that a person who will view the monitoring image on thefront display panel 6F is on the front side, and that the possibility isgreat of being in a state of viewing with good visibility, themonitoring image is displayed on the front display panel 6F.

On the other hand, in the case of a great possibility of a person toview the front display panel 6F not being on the front side, or in thecase of a state estimating that even if a person is there, visibilitywill not be good, the front display panel 6F is turned off.

For example, when a person is the subject, the user selects one of thenight scene and person mode, portrait mode, “soft snap” mode, and smileshutter mode. In the case therein, the person that is the subject canview the front display panel 6F.

Therefore the person that is the subject can view the monitoring imagethat oneself is about to be imaged, and can confirm the expression,pose, and so forth of oneself. The display on the front display panel 6Fcan be effectively used such as confirming by oneself whether or not anexpression is favorable for a photograph, for example.

On the other hand, in the case that the user performs imaging byselecting a night scene and person mode, portrait mode, “soft snap”mode, or smile shutter mode, the display on the front display panel 6Fis turned OFF (only the front display panel 6F is in a power off state,for example), whereby power consumption can be reduced. That is to say,wasteful displays that no one is viewing, or wasteful displays havingpoor visibility, are not performed.

FIG. 6B is another processing example, and is an example of the frontdisplay panel 6F not being in the power off state, even if a person isnot on the front side. Similar to FIG. 6A, in step F101 the CPU 31branches the processing depending on the current imaging mode. In thecase that a predetermined imaging mode is selected, such as night sceneand person mode, portrait mode, “soft snap” mode, or smile shutter mode,the CPU 31 advances the flow to step F102A, and in the state that thedisplay luminance of the front display panel is increased, instructs thedisplay controller 7 to display the monitoring image.

Also, in the case that currently the imaging mode is other that theabove-mentioned predetermined imaging modes, CPU 31 advances the flow tostep F103A, and in the state that the display luminance of the frontdisplay panel 6F is decreased, instructs the display controller 7 todisplay the monitoring image.

That is to say, in the case that a person that can view the frontdisplay panel 6F exists, and estimation is made that visibility for thedisplay is good, the display luminance of the front display panel 6F isincreased so that the monitoring image can be viewed by the person. Onthe other hand, when assumed that there is no person in front, thatvisibility is too bad to view display, or the like, display luminance isdecreased, and reduction in consumption power is realized. In the casethat a display device made up of self emitting elements such as anorganic EL panel is used as the front display panel 6F, decrease indisplay luminance is useful for reduction in consumption power.

Next, the processing example in FIG. 7 will be described. Similar toFIG. 6A, in step F101 the CPU 31 branches the processing depending onthe current imaging mode. In the case that a predetermined imaging modeis selected, such as night scene and person mode, portrait mode, “softsnap” mode, or smile shutter mode, the CPU 31 advances the flow to stepF103, and instructs the display controller 7 to display the monitoringimage on the front display panel 6F.

Also, in the case that the imaging mode is other than the abovepredetermined imaging mode, the CPU 31 advances the flow to step F104,and performs processing such as reading out image data recorded on therecording medium 90 and so forth and preset image data and so forth. Forexample, the CPU 31 instructs the medium interface 10 to execute theplayback of image data from the recording medium 90 (captured image dataand so forth). Alternatively the CPU 31 executes reading out of thepreset image data and captured image data from the flash ROM 33. The CPU31 instructs the display controller 7 to display the read out image datathereof onto the front display panel 6F. That is to say as shown in FIG.4C, image displaying that differs from the monitoring image is executedon the front display panel 6F.

In this case, in the case that a person that can view the front displaypanel 6F exists, and estimation is made that display visibility is good,the state thereof is as shown in FIG. 4B, and the person can monitor theimage of oneself about to be photographed.

On the other hand, when estimating a state that no person is in front,or that the display can be viewed with poor visibility, an unrelatedimage is displayed on the front display panel 6F such as shown in FIG.4C. Even if the person to be the subject does not exist, many times thestate is such that a person is nearby. Also, there is a case where aperson is in a situation wherein the person can readily view the displayof the front display panel 6F, depending on the position of the personthereof.

For a person who is present in those circumferences, the display on thefront display panel 6F can be recognized as a part of the external viewdesign of the imaging apparatus 1, which would be interesting.

Also, in such a case, the user can select an image to be displayed onthe front display panel 6F, whereby the user can set the external viewof his imaging apparatus 1 arbitrarily, and accordingly, the user canenjoy camera use in more ways.

Note that the image data to be read out and displayed from the recordingmedium 90 may in some cases be text data or animation data.

Next, yet another processing example will be shown with FIG. 8. FIG. 8is processing to correspond in the case that as one of theabove-described imaging modes, a self-imaging mode can be selected. Aself-imaging mode is an imaging mode in the case of the user facing thefront side of the imaging apparatus 1 towards oneself.

In step F151 in FIG. 8, the CPU 31 confirms whether or not the currentimaging mode is a self-imaging mode. In the case that the currentimaging mode is a self-imaging mode, the CPU 31 advances the flow tostep F152, and performs processing to turn off the display on the maindisplay panel 6M. Control is performed to display the monitoring imageon the front display panel 6F in step F153.

In the case that the imaging mode is other than a self-imaging mode, theCPU 31 confirms in step F154 whether or not a predetermined imaging modeis selected as the imaging mode, such as night scene and person mode,portrait mode, “soft snap” mode, or smile shutter mode.

In the case of a predetermined imaging mode, the flow is advanced tostep F153, and the display controller 7 is instructed to display amonitoring image on the front display panel 6F.

Also, in the case that imaging mode is other than the abovepredetermined imaging modes, the CPU 31 advances the flow to step F155,and controls the display on the front display panel 6F to be turned off.

That is to say, in the case that the self-imaging mode is selected asthe user setting, the front display panel 6F and main display panel 6Mare in the state shown in FIG. 5A. in the case of not being in theself-imaging mode, the state is similar to that in FIG. 6A.

In the case of the self-imaging mode, the user faces the imagingapparatus toward oneself and performs imaging operations, whereby themain display panel 6M is not viewable. Accordingly, the subject can beconfirmed by viewing the monitoring image on the front display panel 6F.The main display panel 6M is turned off, whereby power consumption canbe reduced.

Note that as a modified example following the processing examples inFIG. 8, other than turning off the display of the front display panel6F, processing examples may be considered in step F155 such asdisplaying in a low-luminance state such as described with FIG. 6A, ordisplaying a playback image or preset image as described with FIG. 7.

<4-2: Processing Example Based on Imaging Mode and User Settings>

In FIGS. 6 through 8 above, examples of controlling the display state ofthe front display panel 6F according to imaging mode have beendescribed, but here an example will be described to perform displaycontrol of the front display panel 6F with consideration for other usersetting states as to the imaging device 1, in addition to the imagingmode.

The imaging mode is one of the user settings, but let us say that theuser's setting mentioned here is a setting state according to the user'soperation other than the imaging mode setting, for example, such asflash emission setting, zoom position operation, or the like.

FIG. 9 shows a display control example that the CPU executes for thefront display panel 6F during the monitoring period.

The monitoring image obtained with the imaging system 2, camera DSP 4 isdisplayed on the main display panel 6M during the monitoring period.That is to say, the CPU 31 executes control to display the imaging datasupplied from the camera DSP 4 on the main display panel 6M as a throughimage during the monitoring period. At this time, in order to performdisplay control for the front display panel 6F, the CPU 31 performs theprocessing in FIG. 9 in parallel.

In step F201 the CPU 31 branches the processing depending on whether thecurrent imaging mode is a predetermined imaging mode suitable to thedisplay of the monitoring image on the front display panel 6F. That isto say, confirmation is made as to whether or not a predeterminedimaging mode, such as night scene and person mode, portrait mode, “softsnap” mode, or smile shutter mode, is selected as the imaging mode.

In the case of a predetermined imaging mode suitable to the display ofthe monitoring image on the front display panel 6F, the CPU 31 advancesthe flow to step F202, and branches the processing depending on whetheror not the user setting state other than the current imaging mode is asetting state suitable to the display of the monitoring image on thefront display panel. In the case determination is made that the usersetting state is a setting state suitable to the display of themonitoring image on the front display panel, the flow is advanced tostep F203, and displaying of the monitoring image is executed with thefront display panel 6F. That is to say, the display controller 7 isinstructed to display the monitoring image displayed on the main displaypanel 6M also on the front display panel 6F. In this case, the displaystates of the main display panel 6M and the front display panel 6F arestates such as shown in FIG. 4B.

On the other hand, in the case determination is made in step F201 thatthe imaging mode is not the above predetermined imaging mode, the CPU 31advances the flow from step F201 to F204, and controls the display ofthe front display panel 6F to be off. Also in the case determination ismade in step F202 that the user settings other than the imaging mode isnot a setting state suitable to the display of the monitoring image forthe front display panel 6F, the CPU 31 advances the flow to step F204,and controls the display of the front display panel 6F to be off. Inthese cases, the display states of the main display panel 6M and thefront display panel 6F are states such as shown in FIG. 4A.

The CPU 31 repeatedly executes the processing FIG. 9 herein during themonitoring period. Accordingly, during the monitoring period, when thepredetermined imaging mode is selected and the user setting state is apredetermined state at the point in time thereof, the monitoring imageis displayed on the front display panel 6F as shown in FIG. 4B.

On the other hand, as a scenery mode or the like, basically when asubject scene that does not include a person is targeted, or when usinga predetermined imaging mode such as portrait mode or the like but theuser setting state is not a predetermined state, the front display panel6F is turned off as shown in FIG. 4A.

User settings are flash emission settings, zoom position operations, andso forth for example, as mentioned above. The application of theprocessing in FIG. 9 for each is as follows.

The flash emission setting of the user's settings will be considered asfollows. The flash emission setting is a setting wherein the userselects whether to execute flash emission (flash-on), whether not toexecute flash emission (flash-off), or whether to automatically executeflash emission on/off (flash-auto). In this case, a case where the usersets flash-on is usually a situation in which the surroundings are dark.In the case of a dark situation, a monitoring image during themonitoring period is in a low luminance state, and accordingly, thevisibility of the display of the front display panel 6F can be conceivedto be poor.

Thus, regarding the flash emission settings, in the case of “flash: on”,the CPU 31 advances to step F204, and the display of the front displaypanel 6F is controlled to be off.

The zoom position operation setting of the user's settings will beconsidered as follows. The zoom position setting is a zoom positionsetting, for example, in the case of the user operating the wide/teleoperating key 5 c in FIG. 1A to perform a zoom operation.

For example, even if a person has been set as a subject, when the zoomposition is at the tele side (telephoto) exceeding a predeterminedposition, the subject person thereof can be assumed to be positioned faraway from the imaging apparatus 1. It goes without saying that if thesubject person is too far away from the imaging apparatus 1, the personthereof will have difficulty in viewing the display of the front displaypanel 6F suitably.

Thus, in the case that the zoom position by the user operation is aposition in a distant state more than predetermined in step F202, theCPU 31 advances the flow to step F204, and controls the display of thefront display panel 6F to be off.

In step F203 in FIG. 9, by the CPU 31 making determinations according tothe user settings as described above, suitable display controls can beperformed for the front display panel 6F. In other words, according tothe processing in FIG. 9, in the case estimation is made that a personwho can view the front display panel 6F exists or that the displayvisibility is good, the person on the subject side can monitor the imageof themselves.

Therefore the person that is the subject can view the monitoring imagethat oneself is about to be imaged, and can confirm the expression,pose, and so forth of oneself. On the other hand, when estimated that aperson is not in front, or that visibility is poor and the state is suchthat the display is not viewable, the front display panel 6F display isturned off (e.g. only the front display panel 6F is in a power offstate). Thus, power consumption can be more suitable reduced.

Note that a flash emission setting and zoom position operation have beendescribed above as user settings, but the determination made using bothof these may be performed in step F202, or determination using only oneof the user settings may be made in step F203.

Also, sensitivity settings, blurring correction on/off settings,specialized imaging settings and so forth can be assumed as usersettings besides those described above. Each of these can also beconceived to be reflected in the determination of step S202 depending onwhether or not a suitable situation is assumed regarding behaviorwherein a subject person views the display of the front display panel 6Fsuitably.

Also, as a modified example according to the processing example in FIG.9, besides turning the display off on the front display panel 6F,processing examples may be considered such as displaying in a lowerluminance state as described with FIG. 6B or displaying a playback imageor preset image as described in FIG. 7.

<4-3: Processing Example Based on Imaging Mode and Internal DetectingInformation>

Next, an example to perform display control of the front display panel6F will be described with consideration for camera detection information(internal detection information) that the imaging apparatus 1 internallydetects, in addition to imaging mode.

The camera detection information mentioned here is information detectedby the internal sensor of the imaging apparatus 1, information that theCPU 31 can recognize in accordance with the operation control of theimaging apparatus 1, e.g., external light quantity detection informationused for flash control or exposure control, zoom position information,focus information, shaking detection information, subject distanceinformation, or the like.

FIG. 10 shows a display control example of the CPU to execute of thefront display panel 6F during the monitoring period.

During the monitoring period, the CPU 31 executes control to display thecaptured image data supplied from the camera DSP 4 as a through image onthe main display panel 6M, but the processing in FIG. 10 for performingdisplay control for the front display panel 6F is performed in paralleltherewith.

In step F301, the CPU 31 branches the processing depending on whetherthe current imaging mode is a predetermined imaging mode suitable to thedisplay of the monitoring image on the front display panel 6F. That isto say, the CPU 31 confirms whether or not a predetermined imaging modesuch as night scene and person mode, portrait mode, “soft snap” mode, orsmile shutter mode is selected.

In the case of confirming that currently a predetermined imaging mode isused, the CPU 31 advances the flow to step F302, confirms predeterminedcamera detecting information, and branches the processing depending onwhether or not the state is suitable for displaying the monitoring imageon the front display panel 6F.

In the case determination is made that the state is currently suitablefor displaying the monitoring image on the front display panel 6F, theCPU 31 advances the flow to step F303, and executes the monitoring imagedisplay on the front display panel 6F. That is to say, the displaycontroller 7 is instructed to display the monitoring image displayed onthe main display panel 6M also on the front display panel 6F. In thiscase, the display states of the main display panel 6M and the frontdisplay panel 6F are states such as shown in FIG. 4B.

On the other hand, in the case the CPU 31 confirms that currently apredetermined imaging mode is not used in step F301, the CPU 31 advancesthe flow to step F304, and controls the display of the front displaypanel 6F to be turned off. Also, in step F302, also in the casedetermination is made that the state is not suitable for displaying themonitoring image on the front display panel 6F, the CPU 31 advances theflow to step F304, and controls the display on the front display panel6F to be turned off. In these cases the display states of the maindisplay panel 6M and the front display panel 6F are states such as shownin FIG. 4A.

The CPU 31 repeatedly executes the processing in FIG. 9 during themonitoring period. Accordingly, when the user selects a predeterminedimaging mode during the monitoring period, and that the state recognizedby the camera detecting information at that point in time is apredetermined state, a monitoring image is displayed on the frontdisplay panel 6F as shown in FIG. 4B.

On the other hand, when selecting a imaging mode other than theabove-mentioned predetermined imaging modes such as scenery modes or thelike, or when the state recognized by the camera detecting informationis not a predetermined state even when a predetermined imaging mode hasbeen selected, the front display panel 6F is turned off as shown in FIG.4A.

The camera detecting information is external light quantity detectioninformation, zoom position information, subject distance information,focus information, shaking detection information, or the like, forexample. The determination in step F302 using the camera detectinginformation herein is as follows.

An external light quantity can be detected from the luminance averagevalue of captured image data, a weighted luminance average valueobtained by applying weighting to a portion within a screen, or thelike, and these are commonly used for automatic exposure control, flashemission control in the case of the flash emission setting is auto, orthe like. These luminance values are calculated, for example, at theimage signal processing unit 41 of the camera DSP 4, whereby the CPU 31can obtain the information thereof.

Also, though not shown in FIG. 2, an arrangement may be made wherein anexternal light quantity sensor or the like is provided, and externallight quantity is detected directly.

In the case that the external light quantity detected with thesetechniques is low, a situation can be assumed wherein even if amonitoring image or the like is displayed on the front display panel 6F,the luminance of the screen itself is low, and accordingly, no excellentvisibility can be obtained. Also, when shooting against a brightbackground, where the external light quantity level is too high, asituation can be assumed wherein it will be difficult to visuallyrecognize the monitoring display of the front display panel 6F suitably.

Thus, even in the case that a predetermined imaging mode is selected, inthe case that the external light quantity is lower than a predeterminedlevel or a backlighting state is determined, the CPU 31 determines thestate to be not suitable to displaying the monitoring image on the frontdisplay panel 6F, the flow is advanced from step F302 to F304, and thedisplay of the front display panel 6F is controlled to be turned off.

With regard to the zoom position information, the CPU 31 drives andcontrols the zoom lens according to the user's operation, whereby thezoom position can be detected. Even if a person has been set as asubject, when the zoom position is in the tele side (telephoto)exceeding a predetermined position, the subject person thereof can beassumed to be positioned far away from the imaging apparatus 1. That isto say, the subject person can be assumed not to be capable of viewingthe display of the front display panel 6F suitably.

Thus in step F302, in the case that the zoom position is a position in adistant state greater than predetermined, the CPU 31 advances the flowto step F302, and controls the display of the front display panel 6F tobe turned off.

The subject distance information is the information of distance from theimaging apparatus 1 to a subject. The CPU 31 can obtain the subjectdistance information using the information from the lens positiondetecting unit 27 as described above. For example, even if a person hasbeen set as a subject, in the case that determination can be made thatthe subject person thereof is in a position far away from the imagingapparatus 1, the subject person can be assumed not to be capable ofviewing the display of the front display panel 6F suitably.

Thus in step F302, in the case that the subject is detected to befarther than a predetermined position by the subject distanceinformation, the CPU 31 advances the flow to step F302, and controls thedisplay of the front display panel 6F to be turned off.

The focus information is the determination information of a focusedstate used for a process for autofocus at the image signal processingunit 41.

In the case of not a focused state, the CPU 31 determines that suitablemonitoring image display is not executable, the flow is advanced fromstep F302 to F304, and controlling the display of the front displaypanel 6F to be turned off can be considered. That is to say, only in thecase of a focused state is the monitoring display to be executed withthe front display panel 6F.

The blurring detection information is the detection information ofshaking, and the motion of the imaging apparatus 1. The CPU 31 canobtain the blurring detection information, for example, as theinformation from the blurring detecting unit 13.

In the case that shaking is great, or in the case that the user ismoving the imaging apparatus 1 to follow a moving subject, or the like,the monitoring image on the front display panel 6F will not be visuallyrecognized suitably. Thus in step F302, in the case that blurring or themovement of the imaging apparatus 1 is determined to be great by theblurring detecting information, the CPU 31 advances the flow to stepF304, and controlling the display of the front display panel 6F to beturned off can be considered.

In step F302 in FIG. 10, suitable display control can be performed forthe front display panel 6F by the CPU 31 making a determinationaccording to all or part of the various types of camera detectinginformation as described above.

That is to say, according to the processing in FIG. 10, when apredetermined imaging mode is selected and a predetermined statesuitable to the monitoring image display with the front display panel 6Ffrom the camera detecting information, the monitoring image is displayedwith the front display panel 6F.

Therefore the person that is the subject can view the monitoring imagethat oneself is about to be imaged, and can confirm the expression,pose, and so forth of oneself. However, in the case an assumption ismade that the state is not suitable to displaying the monitoring imageon the front display panel 6F, the front display panel 6F display isturned off. Thus, power consumption can be more suitable reduced.

Note that as a modified example according to the processing example inFIG. 10, in step F305, besides turning the display of the front displaypanel 6F off, displaying in a low luminance state as described with FIG.7, or displaying the playback image or preset image as described withFIG. 8 may be considered.

<4-4: Processing Example Based on Imaging Mode and Image AnalysisInformation>

Next, an example to perform display control of the front display panel6F will be described with consideration for image analysis information,in addition to imaging mode. The image analysis information isinformation obtained by an image analyzing process that the imageanalyzing unit 44 executes.

FIG. 11 shows a display control example that the CPU executes for thefront display panel 6F during the monitoring period.

As described above, in the monitoring period, a monitoring imageobtained in the processing of the imaging system and camera DSP 4 isdisplayed on the main display panel 6M. That is to say, during themonitoring period, the CPU 31 executes control to display the capturedimage data supplied from the camera DSP 4 on the main display panel 6Mas a through image.

At this time, in order to perform display control for the from displaypanel 6F, the CPU 31 performs the processing in FIG. 11 in parallel withthe display control of the main display panel 6M.

In step F401, the CPU 31 branches the processing depending on whetherthe current imaging mode is a predetermined imaging mode suitable to thedisplay of the monitoring image of the front display panel 6F. That isto say, the CPU 31 confirms whether or not a predetermined imaging mode,such as night scene and person mode, portrait mode, “soft snap” mode,smile shutter mode, or the like is selected as the imaging mode.

In the case of confirming the current mode to be an above-mentionedimaging mode, the CPU 31 advances the flow to step F402, and confirmsthe image analysis results with the image analysis unit 44.

The image analyzing unit 44 executes the image analyzing processregarding the captured image data imaged at the imaging system 2 andcaptured in the camera DSP 4 during the monitoring period. For example,the image analyzing unit executes the image analyzing process regardingthe image data of each frame processed at the image signal processingunit 41, or the image data of a frame extracted intermittently from theframes processed at the image signal processing unit 41. Whether or notan image to be recognized as a person is included in the captured imagedata serving as an analyzing target is determined, i.e., whether or notan outline portion to be recognized as a person is included within animage is determined. Subsequently, the image analyzing unit 44 suppliesthe determining result thereof to the CPU 31. In step F402, the CPU 31confirms whether or not presence of a person has been recognized as thedetermining result thereof.

In the case that the existence of a person is confirmed as an imageanalysis result, the CPU 31 advances the flow to step F404, and executesthe monitoring image display with the front display panel 6F. That is tosay, the display controller 7 is instructed to display the monitoringimage displayed on the main display panel 6M also on the front displaypanel 6F.

In this case, the display states of the main display panel 6M and thefront display panel 6F are states such as shown in FIG. 4B.

On the other hand, in the case confirmation is made in step F401 thatthe current mode is not a predetermined imaging mode, the CPU 31advances the processing to step F405, and controls the display of thefront display panel 6F to be turned off. Also, in the case confirmationis made by the image analysis result confirmation in step F402 that aperson does not exist, the CPU 31 advances the flow from step F403 toF405, and controls the display of the front display panel 6F to beturned off.

In this case, the display states of the main display panel 6M and thefront display panel 6F are states such as shown in FIG. 4A.

The CPU 31 repeatedly executes the processing in FIG. 9 during themonitoring period. Accordingly, when the user selects a predeterminedimaging mode and faces the imaging apparatus 1 so that the personbecomes the subject during the monitoring period, a monitoring image isdisplayed on the front display panel 6F.

Also, when selecting a imaging mode other than the predetermined imagingmodes or when targeting a subject scene that does not include a personsuch as scenery or the like, the front display panel 6F is turned off.Note that in the case a predetermined imaging mode is selected, at thepoint in time that a person is to be included in the subject, themonitoring image is to be displayed on the front display panel 6F.

That is to say, according to the processing example herein, not only isthe on/off of the display of the front display panel 6F controlled, inthe case of the above predetermined imaging modes, the monitoring imageis displayed on the front display panel 6F in the case that a personexists as a subject on the front side.

When a person becomes a subject, the person that is the subject can viewthe front display panel 6F. Also, since the imaging mode is apredetermined imaging mode, the visibility is assumed to be in a goodstate. Therefore the person that is the subject can view the monitoringimage that oneself is about to be imaged, and can confirm theexpression, pose, and so forth of oneself. The display on the frontdisplay panel 6F can be effectively used such as confirming by oneselfwhether or not an expression is favorable for a photograph, for example.

On the other hand, in the case that a person does not exist as thesubject, determination is made that there is no one to view the frontdisplay panel 6F. Accordingly, the display on the front display panel 6Fis turned off (only the front display panel 6F is in a power off state,for example), whereby power consumption can be reduced. That is to say,wasteful displays that no one is viewing are not performed.

Note that in step F402, determination is made as to whether or not thereis a person on the front side as a subject, by the image analysisresults of the image analysis unit 44, but in step F402, processing toconfirm the detection results of the approximation sensor 50 shown inFIG. 2 may be performed. Also, in step F402, both of the image analysisresult and the detection result of the proximity sensor 50 may beconfirmed.

Also, determining the existence of a person on the front side byperforming face detection with the image analysis has been describedwith the various processing examples in FIGS. 12 through 14, themodified examples using the approximation sensor 50 can similarlyconsider the cases of FIGS. 12 through 14 also.

Now, the processing in FIG. 11 performs person detection and controlsthe display operation of the front display panel 6F, but as persondetection, detection of a “face” may be performed.

For example, the image analyzing unit 44 determines presence of anoutline to be recognized as a face, and presence of a facial elementsuch as the eyes, nose, mouth, or the like from captured image data, anddetermines whether or not a person's face serving as a subject isincluded in the captured image data.

The processing of the CPU 31 in this case is shown in FIG. 12. Note thatsteps F401, F402, F404, and F405 in FIG. 12 are similar to FIG. 11. Instep F402 the CPU 31 confirms the image analysis results of the imageanalysis unit 44 and determines whether or not a “face” exists. If a“face” is detected, the flow is advanced from step F403A to F404, andthe monitoring image display is executed with the front display panel6F, and on the other hand if a “face” is not detected, the flow isadvanced from step F403A to F405 and the front display panel 6F isturned off. Thus, instead of determination of the whole of a person'sbody, the presence of a person in front may be confirmed bydetermination of a face.

Next, an example of performing display control of the front displaypanel 6F will be described with consideration for various analysisresult information in addition to person recognition, as an imageanalysis result performed with the image analysis unit 44.

Various types of image recognition results can be obtained by other thanperson recognition and face recognition depending on the image analyzingprocess at the image analyzing unit 44. For example, the determinationinformation of an external light quantity can be obtained. Also, therelative motion quantity between the imaging apparatus 1 and the subjectcan be determined according to motion detection of frame comparison,analysis of a blurring quantity for each pixel, or the like.

Further, as the image recognition process in the case that a face imagehas been detected, the size of a face (the percentage of a facialportion occupied within the image of one frame), facial orientation, thedirection in which the eyes of the subject are directed, or the likewithin the screen can also be obtained as analysis results.

Now, a case of thus using more various types of image analysis resultswill be described. FIG. 13 shows a display control example for the CPU31 to execute for the front display panel 6F during the monitoringperiod. Note that steps F401, F402, F403A, F404, and F405 are similar toFIG. 12.

In step F401, the CPU 31 branches the processing depending on whetherthe current imaging mode is a predetermined imaging mode suitable fordisplaying the monitoring image on the front display panel 6F. In thecase that the current imaging mode is not a predetermined imaging modesuitable for displaying the monitoring image on the front display panel6F, the display of the front display panel 6F is controlled to be turnedoff in step F405.

In the case that the current imaging mode is a predetermined imagingmode suitable for displaying the monitoring image on the front displaypanel 6F, the CPU 31 confirms the analysis results with the imageanalysis unit 44 in step F402. However with the present example, notonly detection of the existence of a face, but other various types ofimage recognition processing is performed as described above, and theCPU 31 confirms the analysis result information thereof.

If a “face” of a person is detected, the flow is advanced from stepF403A to F405, and control is performed to turn the display of the frontdisplay panel 6F off.

If a “face” of a person is detected as the analysis result by the imageanalysis unit 44, the CPU 31 branches the processing according to otherimage analysis results in step F410. That is to say, CPU 31 confirms theimage analysis results other than the face, and determines whether ornot the state is suitable to display the monitoring image on the frontdisplay panel 6F.

In the case that the CPU 31 determines from the various types of imageanalysis results that the state is suitable to display the monitoringimage on the front display panel 6F, the flow is advanced to step F404,and the monitoring image display is executed with the front displaypanel 6F. That is to say, the display controller 7 is instructed todisplay the monitoring image displayed on the main display panel 6M alsoon the front display panel 6F. In this case, the display states of themain display panel 6M and the front display panel 6F are states such asshown in FIG. 4B.

On the other hand, in the case determination is made from other analysisresults in step F410 that the state is not suitable to display themonitoring image on the front display panel 6F, the CPU 31 controls thedisplay of the front display panel 6F to be turned off in step F405.

In the event of advancing to step F405 from step F401, F403A, or F410,the display state on the main display panel 6M and front display panel6F.

The CPU 31 repeatedly executes the processing in FIG. 9 during themonitoring period. Accordingly, during the monitoring period when theuser selects a predetermined imaging mode and faces the imagingapparatus 1 so that the face of the person is included in the subject,and the state recognized by the various types of image analysis resultsat the point in time thereof is a predetermined state, the monitoringimage is displayed on the front display panel 6F. On the other hand, inthe case that the imaging mode is not a predetermined imaging mode, oreven if in a predetermined imaging mode the person (face) is notincluded in the subject, further, in the case of a predetermined imagingmode and the face is included in the subject but the state recognized byvarious types of analysis results is not a predetermined state, thefront display panel 6F is turned off.

A processing example of step F410 according to the image analysisresults other than the existence of a face is as follows. External lightquantity can be determined as image analysis results. In the case theexternal light quantity is low, or excessively high such as whenshooting into bright light or the like, the monitoring display on thefront display panel 6F can be assumed not to be recognized suitably, asdescribed above with the camera detection information.

Thus, even in a case that face detection is made in a predeterminedimaging mode, in a case wherein determination is made that the externallight quantity is lower than a predetermined level or is in abacklighting state, the CPU 31 deems the state to not be suitable fordisplaying the monitoring image on the front display panel 6F. That isto say, in step F405 the display of the front display panel 6F iscontrolled to be turned off.

Also, the relative motion quantity between the imaging apparatus 1 andthe subject can be determined to be the image analysis result. That isto say, a case where the imaging apparatus 1 itself is blurred or moving(the user is moving the imaging apparatus 1), or a case where thesubject is moving, or a case where both are moving can be determined.

When the motion quantity in these cases is great, it can be conceivedthat even if there is a person serving as a subject, the subject personthereof will have difficulty in recognizing the front display panel 6Fsuitably.

Thus in step F410, in the case the CPU 31 determines that the relativemovement of the imaging apparatus 1 and the subject is great, the flowis advanced to step F405, and the display of the front display panel 6Fmay be controlled to be turned off.

Not only simple face detection but also a face size (percentage of afacial portion within the screen) can be determined for image analysis.Though depending on the zoom position state, if a certain fixed zoomstate is considered, the size of a face can serve as an index todetermine the distance from the imaging apparatus 1 to the personserving as a subject. For example, in the case that even if the zoomstate is a wide state, but a face is shot small, the person thereof canbe assumed to be in the distance.

Therefore, in step F410 the CPU 31 determines the distance of a subjectperson based on the size of a face of the person thereof while takingthe zoom position into consideration. Subsequently, in the case that theperson thereof is in the distance, and has difficulty in viewing thedisplay content of the front display panel 6F, in step F405 it can beconceived that the CPU 31 controls to the display of the front displaypanel 6F to be turned off.

Also, a facial orientation or the direction in which the eyes of thesubject are directed can also be recognized for image analysis. In thecase that a face is not in the front direction on a captured image, orin the case that the subject is not looking at the imaging apparatus 1,the subject person thereof can be determined not to be viewing theimaging apparatus 1, i.e., the front display panel 6F.

Therefore, in step F410 the CPU 31 confirms the facial orientation orthe direction in which the eyes of the subject are directed. In the casedetermination is made that the person thereof is not looking at thedisplay content of the front display panel 6F, the display of the frontdisplay panel 6F may be controlled to be turned off.

In step F410 in FIG. 13, suitable display control can be performed forthe front display panel 6F, by the CPU 31 performing determinationsaccording to the image analysis results as described above.

That is to say, according to the processing in FIG. 13, in apredetermined imaging mode, when face detection is made and thepredetermined state from other image analysis results, the monitoringimage is displayed with the front display panel 6F. In a situationwherein this is suitable as a situation wherein a person exists on thefront side of the subject and which is estimated from the imaging mode,and the person on the subject side can suitable visually confirm (or isvisually confirming) the monitoring image from the image analysisresults, the monitoring image is displayed on the front display panel6F. Accordingly, the monitoring image display of the front display panel6F is performed in a state wherein the probability that the person thatis the subject will view the display on the front display panel 6F isextremely high.

Also, in the case that a person that is a subject does not exist, or inthe case that visibility is poor or a person exists but there is noreason to perform the monitoring image display on the front displaypanel 6F (not viewing or not viewable), the display on the front displaypanel 6F is turned off. Thus, power consumption can more suitably bereduced.

Next FIG. 14 shows a modified example of the processing example in FIG.13 which is applicable in the case of the smile shutter mode describedabove as one of the imaging modes. Other than F420 through F422 in FIG.14, the flow is the same as FIG. 13. Note that in FIG. 13 a releaseoperation by the user (trigger for moving to the imaging period) is notindicated, but the processing up to the imaging period is indicated assteps F420 through F422 in FIG. 14.

According to the image analysis processing, in addition to facedetection and the various types of detections mentioned above,expressions of the subject person can also be determined. Thus, in theevent that monitoring display is performed with the front display panel6F according to the imaging mode, existence of a subject person, andother analysis results, the CPU 31 can confirm the results of theexpression determination of the subject person in step F420.

In the case that a smiling state is obtained from the image analysisresults as the expression determination, the flow is automaticallyadvanced to step F422, and release processing, i.e. the recordingprocessing of the captured image data at the point in time thereof isperformed. Note that in the case that the user manually has performed arelease operation, the flow is advanced from step F421 to F422 andrelease processing is performed.

Thus, by combining the monitoring display on the front display panel 6Fand the smile shutter mode processing, the person that is the subjectcan view one's own expression on the front display panel 6F and smile,whereby the recording of the captured image can be performed.

Note that in the modified examples according to the processing examplesin FIGS. 11 through 14, in step F405, besides turning the display of thefront display panel 6F off, displaying in a low luminance state asdescribed with FIG. 6B, or displaying the playback image or preset imageas described with FIG. 7 may be considered.

Also, in the processing examples in FIGS. 12 through 14, determinationis made as to whether or not a person who can visually confirm the frontdisplay panel is on the front side, by the face detection by the imageanalysis, but a person detection (detection of a body of a person withinan image) instead of face detection may be used. Also, detection resultsfrom an approximation sensor 50 may be used.

5. Display Control of the Front Display Panel Unit when Playing

The various processing examples described up to this point are controlprocessing examples of the front display panel 6F during the monitoringperiod, but now a display control example of the front display panel 6Fduring the playback period will be described.

As described in FIG. 3, in the case that the user has performed anoperation to instruct a playback operation, the imaging apparatus 1proceeds to a playback operation state (playback period). During theplayback period, an operation to play the image recorded in therecording medium 90 or flash ROM 33 is executed.

The CPU 31 reads out the image recorded in the recording medium 90 orflash ROM 33 in response to the user's operation, and instructs thedisplay controller 7 to display thumbnail images or a playback image onthe main display panel 6M.

At this time, the CPU 31 performs the processing in FIG. 15 relating tothe front display panel 6F.

In step F501 in the playback period, the CPU 31 determines whether thedisplay mode is a display mode to perform display on the main displaypanel 6M and the front display panel 6F, or a display mode to performdisplay only on the main display panel 6M. For example this display modecan be selected by a user operation.

If not a display mode to perform both screen displays, the CPU 31advances the processing from the step F501 to F505, and executes controlto turn the front display panel 6F. That is to say, the playing imagedisplay is performed only on the main display panel 6M.

If in a display mode to perform both screen displays, the CPU 31advances the flow from step F501 to F502, and branches the processingaccording to the playing display state of the current main display panel6M. That is to say, currently, the CPU 31 branches the process dependingon whether a thumbnail list of playback images or a single image isdisplayed on the main display panel 6M.

In the case that a single playback image is now displayed on the maindisplay panel 6M, the CPU 31 advances the process to step F503 toinstruct the display controller 7 to display the same playback imagedata on the front display panel 6F as well. In this case, the displaystates of the main display panel 6M and the front display panel 6F arestates such as shown in FIG. 5C.

On the other hand, in the case that a thumbnail list is now displayed onthe main display panel 6M, the CPU 31 advances the process to step F504.In this case, the CPU 31 instructs the display controller 7 to displayon the front display panel 6F playback image data selected by the cursorK on the thumbnail list display. In this case, the display states of themain display panel 6M and the front display panel 6F are states such asshown in FIG. 5B.

By the CPU 31 executing such a process, a person in the front side canalso view on the front display panel 6F side simultaneously.Accordingly, the user of the imaging apparatus 1, and the person in thefront side can enjoy a playback image.

Also, as shown in FIG. 5B, in the case that a thumbnail list isdisplayed on the main display panel 6M, the user of the imagingapparatus 1 moves the cursor K, whereby a person in the front side canview the selected playback image on the front display panel 6F side.

6. Modification Examples

The various types of process examples, and modifications serving asembodiments have been described so far, but further variousmodifications can be conceived as embodiments of the present invention.

For example, an arrangement may be made wherein, in the case that commonmonitoring image display is not executed on the front display panel 6F,an example is given wherein the display of the front display panel 6F isturned off, the display of the front display panel 6F is set tolow-intensity display, or a playback image or preset image is displayedon the front display panel 6F, but the user can select which of thesestates to use.

With the present embodiment, examples for performing display control ofthe front display panel 6F have been described, under the assumption ofwhether or not the imaging mode is a predetermined imaging mode toestimate the state suitable for displaying the front display panel 6F,and further by combining user setting state, determinations by cameradetecting information (internal detecting information), and imageanalysis results. These may be further combined.

For example, an example to perform display control of the front displaypanel 6F with the imaging mode, user setting state, and camera detectinginformation may be considered.

Also, an example to perform display control of the front display panel6F with the imaging mode, user setting state, and image analysis resultsmay be considered.

Also, an example to perform display control of the front display panel6F with the imaging mode, camera detecting information, and imageanalysis results may be considered.

Also, an example to perform display control of the front display panel6F with the imaging mode, user setting state, camera detectinginformation, and image analysis results may be considered.

Also, as a shooing mode, there are cases wherein an automatic mode isprepared besides the examples described above. An automatic mode is amode wherein the CPU 31 sets suitable imaging parameters and controlsthe processing of the imaging system 2 and camera DSP 4 according toexternal-light state, image analysis, and the like.

In the case that an automatic mode is prepared as an imaging mode, forexample the automatic mode may be one of the predetermined imaging modessuitable to the display of the front display panel 6F. Processing suchas that in FIGS. 9 through 14 is applied, and the display state of thefront display panel 6F is controlled according to the camera detectinginformation, user setting information, and image analysis results.

With the present embodiment, description is given under the assumptionof a still image shoot. However, the present example can also be appliedto a moving image. In the case of a moving image, the above-mentionedmonitoring period is similar to a standby period until the imagingstarts. The above-mentioned recording period is the moving imagerecording period from recording start until recording end. Accordingly,the moving image display control of the front display panel 6F isperformed during the standby period and recording period.

If an imaging apparatus 1 can shoot both a still image and moving image,a moving image mode is prepared as one of the imaging modes. The movingmode herein goes to one of the predetermined imaging modes applicable tothe display of the front display panel 6F. In the standby period andrecording period, the processing such as that in FIGS. 9 through 14 isapplied, and the display state of the front display panel 6F iscontrolled according to the camera detecting information, user settinginformation, and image analysis results.

With the present example, an apparatus generally called a digital stillcamera has been exemplified as the imaging apparatus 1, but anembodiment of the present invention can be applied to various types ofapparatuses, for example, such as video cameras, cellular phones havingimaging functions, PDAs (Personal Digital Assistant), and so forth.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

1. An imaging apparatus comprising: a first display panel unitconfigured to execute display toward a user side, disposed on anapparatus casing; a second display panel unit configured to executedisplay toward a subject side, disposed on said apparatus casing; animaging processing unit configured to subject incident light from saidsubject side to photoelectric conversion to obtain a captured imagesignal; and a control unit configured to execute imaging processingcontrol according to imaging mode, and execute display based on thecaptured image signal obtained by said imaging processing unit with saidfirst display panel unit, while controlling the display operations basedon the captured image signal obtained with said imaging processing unitof said second display panel unit at least according to said imagingmode.
 2. The imaging apparatus according to claim 1, wherein saidcontrol unit performs control to execute display based on the capturedimage signal obtained with said imaging processing unit on said seconddisplay panel, in the case that said imaging mode is a predeterminedimaging mode out of a plurality of imaging modes.
 3. The imagingapparatus according to claim 2 wherein said control unit performscontrol to turn the display of said second display panel off in the casethat said imaging mode is not said predetermined imaging mode.
 4. Theimaging apparatus according to claim 2 wherein said control unitperforms control to execute display based on the captured image signalobtained with said imaging processing unit on said second display panelunit in a low luminance state, in the case that said imaging mode is notsaid predetermined imaging mode.
 5. The imaging apparatus according toclaim 2, further comprising: an image data reading unit configured toread image data recorded on a storage medium; wherein said control unitperforms control to execute display based on image data read out by saidimage data reading unit on said second display panel, in the case thatsaid imaging mode is not said predetermined imaging mode.
 6. The imagingapparatus according to claim 1 wherein said control unit controls thedisplay operation based on the captured image signal obtained with saidimaging processing unit on said second display panel unit, based on saidimaging mode and a settings state according to the operations of theuser relating to operations of the imaging apparatus other than theimaging mode.
 7. The imaging apparatus according to claim 1 wherein saidcontrol unit controls the display operation based on the captured imagesignal obtained with said imaging processing unit on said second displaypanel unit, based on said imaging mode and the internal detectinginformation of the imaging apparatus.
 8. The imaging apparatus accordingto claim 1, further comprising: an image analysis unit configured toperform image analysis of the captured image signal obtained with saidimaging processing unit, wherein said control unit controls the displayoperation based on the captured image signal obtained with said imagingprocessing unit with said second display panel unit, based on saidimaging mode, and an image analysis information from said image analysisunit.
 9. The imaging apparatus according to claim 8, wherein said imageanalysis unit detects whether or not a person exists in said subjectside from the image analysis of the captured image signal obtained withsaid imaging processing unit.
 10. The imaging apparatus according toclaim 1, further comprising: an operating unit configured to select saidimaging mode.
 11. A display control method for an imaging apparatus witha first display panel unit configured to execute display toward a userside and a second display panel unit configured to execute displaytoward a subject side comprising the steps of: executing display on thefirst display panel based on a captured image signal obtained bysubjecting incident light from the subject side to photoelectricconversion; and controlling display operations of said captured imagesignal on the second display panel according to an imaging mode selectedfrom various types of imaging modes to perform imaging processingsuitable to the imaging situation.